
Reo'd PCT/PTO 19 



les Patentamt 
irop^VPTPatent Office 
Office europeen des brevets 



vi/fiu 19 CCD 21 

iiiiiiiiiiiiii 



(11) 



(12) 



(43)" Date of publication: 

09.01 .2002 Bu lletin 2002/02 

(21) Application number: 01115018.2 

(22) Date of filing: 20.06.2001 



EP 1 170 953 A2 

EUROPEAN PATENT APPLICATION 

^- ^ - (5-1 ) Int C\7: HOAH 7/18 " ^ " 



(84) 


Designated Contracting States: 


(72) 


Inventors: 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


• 


Hirayama, Naofumi 




IWC NL PT SE TR 




Meguro-ku, Tokyo (JP) 




Designated Extension States: 


• 


Tomono, MIzukI 




AL LT LV MK RO SI 




Meguro-ku, Tokyo (JP) 






• 


Nakatsuka, Yoshinori 


(30) 


Priority: 03.07.2000 JP 2000200782 




Meguro-ku, Tokyo (JP) 


18.07.2000 JP 2000217773 


• 


Arakawa, Mikiko 








Iruma-shi, Saltama (JP) 


(71) 


Applicants: 




Kobayashi, Katsumi 


• 


Pioneer Corporation 




Kawaguchi-shI, Saltama (JP) 




Meguro-ku, Tokyo (JP) 


(74) 




• 


Pioneer Design Corporation 


Representative: 




Meguro-ku, Tokyo (JP) 




Manitz, Finsterwald & Partner GbR 






Postfach 31 02 20 








80102 Miinchen (DE) 



(54) 



for using the same 



(57) Real-time images and audio are monitored 
from a remote place anytime at an arbitrary place ^with 
a portable telephone. The portable telephone comprises 
a display panel which can display a moving image, an 
image signal receiving partwhich receives an imagesig- 
nal sent over the mobile communication network N2, an 
image signal reproducing part which reproduces the im- 
age signal which has been received by this image signal 
receiving part and makes the display part display the 
reproduced image , and a permission signal sending part 
for sending a permission signal to permit an image-pick- 
up part to output an image signal to the image-pickup 
part to be connected via the mobile communication net- 
work. According to another aspect, a portable infomna- 



tlon terminal is constructed so that the sender can easily 
send information of the place orsurrounding view where 
he/she is, and comprises a sending/receiving part which 
sends/receives an image signal via the mobile commu- 
nication network, a display panel which displays an im- 
age according to the received image signal, and a CCD 
camera which performs imaging and sends an image 
signal by the sending/receiving part. The view of the sur- 
rounding area is imaged by the CCD camera, the ob- 
tained Image signal is sent to another portable tele- 
phone that Is line-connected via the mobile communi- 
cation network, and thus the picked-up image of the sur- 
rounding area is displayed on the display panel of the 
other portable telephone. 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 



[0001] The present invention relates to a multi-func- 
tional portable telephone equipped with a display and a 
remote monitoring system using the same portable tel- 
ephone. The present Invention also relates to a portable 
infomiation terminal which exchanges information over 
a mobile communication network and methods for using 
the same. 

2. Description of Related Art 

[0002] in general, as is often the case with people who 
are not at home, they have concerns about their homes 

during their absence. 

[0003] For example, If people keep pets such as dogs 
and cats, there are cases where the owners want to 
know how their pet left at home spends time during the 
master's absence. 

[0004] In order to deal with such cases, the use of a 
remote monitoring system may be considered so that 
the house is monitored. However, according to the con- 
ventional remote monitoring system, images of the ob- 
ject to be monitored are monitored at all times in an ob- 
servation center or the like and the system cannot be 
used for the purpose that a family member sees an Im- 
age showing his/her house in real time at anytime at an 
unspecified place outside his/her house. Therefore, 
conventionally, there has been a demand to develop a 
method whereby people can easily monitor images of 
their homes during their absence. 
[0005] In recent years, portable infonnation temiinals 
such as portable telephones or personal digital assist- 
ants (PDAs) and the like which perform exchanges of 
conversations and information using a mobile commu- 
nication network have quickly become widespread and, 
in particular, portable telephones have become Indis- 
pensable foryoung people as means of communication. 
[0006] For example, when friends plan to meet each 
other In a downtown area, in the past rt had been nec- 
essary to arrange the date, time, and place beforehand. 
However, with the spread of potable telephones, recent- 
ly, a method for meeting has been frequently used, 
wherein friends meet at a meeting place on the appoint- 
ed day while confirming the other's location to each oth- 
er by their portable telephones. 

[0007] However, even with this method for meeting 
while friends are confirming the other's location to each 
other by their portable telephones, if there is no land- 
mark nearby to use as a guide or if one of them is at a 
place where the location cannot be easily specified, 
there is a case where he/she cannot explain the place 
where he/she is and they cannot easily meet. 
[0008] Also, there is a case where the person is poor 
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at explaining the place where he or she is orthe person 
does not know the place where he or she Is. 

OBJECTS AND SUMMARY OF THE INVENTION 

5 

[0009] The present invention has been developed to 
meet the aforementioned conventional requirements. 
[0010] That is, it is an object of the present Invention 
to make It possible to monitor real-time images and au- 

10 dio from a remote place anytime at an arbitrary place. 
[0011] In ordertoachievetheaboveobject, aportable 
telephone according to a first aspect of the present in- 
vention comprises: a display part which can display a 
moving Image; an image signal receiving part which re- 

15 ceives an image signal sent over a mobile communica- 
tion network; an image signal reproducing part which re- 
produces the image signal which has been received by 
this Image signal receiving portion and makes the dis- 
play portion display the reproduced image, and a per- 

20 mission signal sending part for sending a permission 
signal to pennit a Image-pickup portion to output an Im- 
age signal to the image-pickup portion to be connected 
via the mobile communication network. 
[0012] A portable telephone according to the first as- 

25 pect of the present Invention is connected, for example, 
to an Image-pickup part installed at a desirable place 
such as, for example, the user's house via a mobile com- 
munication network and permits this image-pickup part 
connected via the mobile communication network to 

30 output an image signal imaged by the Image-pickup by 
sending a permission signal such as a tone signal indi- 
cating a password that has been set by the user before- 
hand from a permission signal sending portion to the Im- 
age-pickup portion connected via the mobile communi- 

35 cation network. 

[0013] Then, the portable telephone receives the Im- 
age signal sent from this image-pickup portion via com- 
munication networks by means of the Image signal re- 
ceiving part, reproduces the image signal by means of 

40 the Image signal reproducing part, and makes the dis- 
play part display the reproduced images. 
[0014] As described above, according the first aspect 
of the Invention, It becomes possible to monitor a real- 
time image and audio from a remote place via a mobile 

45 communication network anytime at an arbitrary place 
' and it becomes possible for a person, for example, to 
see the state of his or her house easily and in real time 
while he or she is away. 

[0015] Then, since monitoring of this image is per- 
50 formed by sending a permission signal such as a pass- 
word set by the user, there is no danger of a third party's 
access to the image. 

[0016] In orderto achieve the above object, in addition 
to the construction according to the first aspect, a port- 
55 able telephone according to a second aspect of the in- 
vention further comprises a decompressing portion for 
decompressing a compressed digital image signal 
which has been received by the image signal receiving 
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portion, whereby even if a digital Image signal to be sent 
from the image-pickup portion has been compressed 
when being sent, this digital image signal can be decom- 
pressed for displaying in the display portion. 
[001 7] In order to achieve the above object, a remote 
-nnonitoring system by means of a portable telephone ac- 
cording to a third aspect of the present invention com- 
prises a portable telephone and a monitoring camera 
device which is connected to this portable telephone via 
a mobile communication networka and sends an Image 
signal obtained by imaging, wherein 

the portable telephone comprises: a display por- 
tion which can display amoving Image; an Image signal 
receiving portion which receives an Image signal sent 
over a mobile communication network; an image signal 
reproducing portion which reproduces the image signal 
which has been received by this image signal receiving 
jDortion and makes the display portion display the repro- 
duced Image; and a permission signal sending portion 
for sending a permission signal to permit the monitoring 
camera device to output an image signal to the monitor- 
ing camera device to be connected via the mobile com- 
munication network, wherein the monitoring camera de- 
vice comprises: 

an image pickup portion which Is installed and ori- 
ented toward a desirable object to be monitored and an 
image signal sending permission portion which detects 
the permission signal to be sent from the permission sig- 
nal sending portion of the portable telephone via the mo- 
bile communication network and permits sending of an 
image signal from the image-pickup portion to the port- 
able telephone. 

[0018] In terms of a remote monitoring system by 
means of a portable telephone according to the third as- 
pect of the present invention, a monitoring camera de- 
vice is installed at an arbitrary place desired by a user 
such as, for example, the user's house in a manner 
where an Image-pickup part of the monitoring camera 
device is oriented toward, for example, a desirable ob- 
ject to be monitored in a room of the user's house where 
his or her pet or the like stays. 

[0019] Then, the portable telephone Is connected to 
this monitoring camera device via the mobile communi- 
cation network and sends a permission signal such as 
a tone signal indicating a password that has been set 
by a user beforehand to the monitoring camera device 
thus connected via the mobile communication network. 
[0020] Upon the permission signal being detected by 
-the image signal sending permission portion, the moni- 
' toring camera device that has received this permission 
signal sends an Image signal obtained through imaging 
of a desirable object to be monitored by the image-pick- 
up portion to the potable telephone connected via the 
mobile communication network. 

[0021] Then, the portable telephone receives the im- 
age signal sent from this Image-pickup portion via com- 
munication networks by means of the image signal re- 
ceiving portion, reproduces the image signal by means 
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of the image signal reproducing portion, and makes a 
■ display portion display the reproduced image. 
[0022] As described above, according the third aspect 
of the invention, it becomes possible to monitor a real- 
5 time image and audio from a remote place via the mobile 

eommunication-network-anytlme-at-an arbitrary place - — - 

and it becomes possible for a person, for example, to 
see the state of his/her house easily and In real time 
while he/she is away. 
10 [0023] . Then, since the monitoring camera device 
sends the image signal upon a condition that the per- 
mission signal such as a password set by a user is de- 
tected, there Is no danger of a third party's access to the 
image. 

15 [0024] In order to achieve the above object, in addition 
to the construction according to the third aspect, a re- 
mote monitoring system by means of a portable tele- 
phone according to a fourth aspect of the invention fur- 
ther comprises a compressing portion for compressing 

20 an image signal to be sentfrom the image pickup portion 
to the portable telephone, and whereby the time for 
sending the image signal from the monitoring camera 
device to the portable telephone can be shortened. 
[0025] In order to achieve the above object, in addition 

25 to the construction according to the third aspect, a re- 
mote monitoring system by means of a portable tele- 
phone according to a fifth aspect of the invention further 
comprises a decompressing portion for decompressing 
a compressed image signal which has been received by 

30 the image signal receiving portion and whereby even a 
digital image signal to be sent from the image-pickup 
portion has been compressed when being sent, this dig- 
ital image signal can be decompressed for displaying in 
the display portion. 

35 [0026] The present Invention has been developed fur- 
ther to extend the methods for using portable digital as- 
sistants as communication means and another object of 
the present invention is to make it possible for a person 
to easily inform of the place where he/she is orsurround- 

40 ing state by means of a portable digital assistant. 

[0027] In order to achieve the above object, a portable 
infonnation tenninal according to a sixth aspect of the 
invention comprises: a sending/receiving portion which 
sends/receives an image signal via a mobile communi- 

45 cation network; an image display portion which displays 
an image by the image signal received by this sending/ 
receiving part; and an image-pickup part which performs 
imaging and sends an image signal obtained through 
the imaging by means of the sending/receiving part. 

50 [0028] The portable information terminal according to 
the si5Cth aspect is line-connected to a tenninal such as 
another portable information tenninal equipped with an 
image display portion or a microcomputer via the mobile 
communication network. 

55 [0029] Then, when a view around the place where the 
portable infonnation terminal is located is imaged by the 
image-pickup portion, an image signal obtained by this 
imagepickup portion is sent by the sending/receiving 
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portion to another portable information terminal and the 
like that has been line-connected, and the Imaged view 
is displayed in the image display part of said another 
portable information terminal. 

[0030] Also, when this portable information terminal ^ 
receives an image signal showing a view from another 
portable information terminal and the like via the mobile 
communication network, based on such an image sig- 
nal, the portable information terminal makes the image 
display portion display an image based on the Image fo 
signal. 

[0031 ] As described above, according to the sixth as- 
pect of the present invention, it becomes possible to vis- 
ually inform the receiver of the surroundings of the send- 
er and therefore, for example, in a case where friends 
are meeting in a downtown area, in a condition where 
the portable infomnation terminals which they carry are 
line-connected to each other via mobile communica- 
tions networks, by imaging a surrounding view by 
means of an image-pickup portion of one portable Infor- 
mation terminal and sending the image signal to the oth- 
er portable infomnation terminal, the sender can visually 
inform the receiver whom the sender is meeting of the 
location where the sender is. 

[0032] Accordingly, even if there is no guide indicating 
where the sender is or if streets are complicated and 
explanation thereof is difficult for the sender, the sender 
can easily inform the receiver of the location where the 

sender is. 

[0033] In particular, when it is difficult to only vocally 30 
explain the place and the like or when the sender is poor 
at explanation, it becomes very effective to provide the 
receiver with the above described images. 
[0034] Furthermore, in addition to the method for us- 
ing a portable infomnation terminal as described above, 35 
this portable information terminal can be used in other 
methods. For example, when a person is involved in an 
accident, It can be used to image the scene of the acci- 
dent for sending and when a person meets with disaster, 
It can be used to image the sun-ounding view for sending 40 
so that the receiver confirms the scene of the disaster. 
[0035] Moreover, this portable Infomnation terminal 
can be used in still another method wherein when the 
sender wants to talk with the receiver at a distant place 
about a commodity that the sender wants to buy, the ^5 
sender can image the commodity and send the Image 
signal thereof. 

[0036] In ordertoachievethe above object, In addition 
to the construction according to the sixth aspect, a port- 
able information terminal according to a seventh aspect 50 
of the invention is characterized in that the image-pickup 
portion is a CCD camera, thus making it possible to im- 
age the surrounding view by means of a small-sized 
portable information terminal such as a portable tele- 
phone. 55 
[0037] In order to achieve the above object, a method 
for using a portable Information terminal according to an 
eighth aspect of the present invention uses a portable 
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information terminal comprising a sending/receiving 
part which performs sending/receiving of an Image sig- 
nal via a mobile communication network, an Image dis- 
play part which displays an image by an image signal 
received by this sending/receiving part, and an image- 
pickup portion which performs imaging and sends an Im- 
age signal obtained through imaging by means of the. 
sending/receiving part; images the surrounding view by 
means of the image-pickup device; sends the image sig- 
nal obtained through this Imaging to another portable 
Information tenninal that is line-connected via the mo- 
bile communication network by means of a sending/re- 
ceiving part; and makes the image of the surrounding 
view thus imaged to be displayed in an image displaying 
portion of another portable information terminal. 
[0038] This method for using a portable Information 
terminal according to an eighth aspect makes it possible 
for the sender to Inform the receiver of the surrounding 
state and, for example, in a case where friends are 
meeting in a downtown area, in a condition where the 
portable information terminals which they carry are line- 
connected to each other via the mobile communication 
network, by imaging a surrounding view by means of an 
Image-pickup part of one portable information terminal 
and sending the image signal to the other portable In- 
formation tenninal, the sender can visually Inform the 
receiver whom the sender is meeting of the location 
where the sender is. 

[0039] Accordingly, even if there Is no guide indicating 
where the sender Is or if streets are complicated and 
explanation thereof is difficult for the sender, the sender 
can easily inform the receiver of the location where the 
sender is. 

[0040] In particular, when it Is difficult to only vocally 
explain the place and the like or when the sender is poor 
at explanation, it becomes very effective to provide the 
receiver with the above described image. 
[0041] Furthermore, in addition to the method for us- 
ing a portable Information tenninal as described above, 
this portable information terminal can be used in other 
methods. For example, when a person is involved in an 
accident, it can be used to Image the scene of the acci- 
dent for sending and when a person meets with disaster, 
it can beusedto Imagethe surrounding viewforsending 
so that the receiver confimns the scene of the disaster 
[0042] Moreover, this portable Information terminal 
can be used in still another method wherein when the 
sender wants to talk with the receiver at a distant place 
about a commodity that the sender wants to buy, the 
sender can image the commodity and send an image 
signal thereof. 

[0043] In order to achieve the above object, a method 
for using a portable information terminal according to a 
ninth aspect of the present invention Is characterized in 
that the surrounding view to be imaged by the image- 
pickup device shows the surrounding view of the meet- 
ing place, whereby even if there is no guide indicating 
where the sender is or if streets are complicated and 
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explanation thereof is difficult for the sender, the sender 
can easily inform the receiver whom the sender is meet- 
ing of the location where the sender is and, in particular, 
this method becomes very effective when it is difficult to 
only vocally explain the place and the like or when the 
senSeFls poor at explanation. " — — 

BRIEF DESCRIPTION OF THE DRAWINGS 



[0044] 



Fig. 1 Is a front view illustrating a portable telephone 
according to an example of the present Invention, 
with the open/close cover being closed. 
Fig. 2 is a front view illustrating the portable tele- 
phone of the present invention with the open/close 
cover being opened. 

Fig. 3 Is a block diagram illustrating the control por- 
tion of the portable telephone of the present Inven- 
tion. 

Fig. 4 is an explanatory view illustrating an arrange- 
ment of application windows according to the em- 
bodiment of the present invention. 
Figs. 5A through 5F are explanatory views illustrat- 
ing various examples of application windows ac- 
cording to the embodiment of the present invention. 
Fig. 6 Is an explanatory conceptual view illustrating 
the display fomn of application windows according 
to the embodiment of the present invention. 
Fig. 7 is an explanatory conceptual view illustrating 
the form of application windows according to the 
embodiment of the present invention. 
Fig. 8 is an explanatory view Illustrating the concept 
of the arrangement of the input edit window of each 
application according to the embodiment of the 
present Invention. 

Fig. 9 is a block diagram showing an embodiment 
of the monitoring camera device according to the 
present invention. 

Fig. 1 0 is a flowchart showing the main routine of 
the window display control to be performed by the 
control portion according to the embodiment of the 
present invention. 

Fig. 11 is a view showing a window example dis- 
played in the display panel of the portable telephone 
according to the embodiment of the present Inven- 
tion. 

Fig. 12 is an explanatory view showing an image 
-example showing the surrounding view displayed in 
the portable information terminal of the present in- 
vention. 



DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 



[0045] Now, an preferred embodiment of the present 
invention will be explained below in detail with reference 
to the accompanying drawings. 



[0046] Fig. 1 is a front view Illustrating a portable tel- 
ephone according to the present invention, and Fig, 2 is 
a front view illustrating a form of the portable telephone 
when operated. 
5 [0047] Referring to Figs. 1 and 2, a portable telephone 
--"^10 has a display panel 1 2 arranged at the central portion - 
of the surface of a main body casing 11 , and an open/ 
close cover 13 disposed at the lower portion of the dis- 
play panel 12. 

10 [0048] The open/close cover 1 3 is rotatably attached 
vertically at the upper end portion thereof to the main 
body casing 11 by means of an axle 13A, which is par- 
allel to the lower end rim of the display pane! 12. 
[0049] In addition, there is provided a control panel 1 4 

15 on the portion to be covered with the open/close cover 
13 of the main body casing 11 . As shown in Fig. 2, on 
the surface of the control panel 14, there are arranged 
first operation keys K1 such as telephone number input 
keys and function keys. Moreover, on the reverse side 

20 of the open/close cover 1 3 (which is the front side when 
the cover is opened), there are arranged second oper- 
ation keys K2. 

[0050] There Is provided a CCD camera 1 8 on the up- 
per right portion of the main body casing 11 as shown 
25 in the figures. There is also provided a spectrum dial 1 9 
on the left such as for switching the display windows of 
the display panel 12. 

[0051] Fig. 3 is a block diagram illustrating an exam- 
ple of the configuration of the control portion of the port- 

30 able telephone 10. 

[0052] Referring to Fig. 3, an antenna 20 attached to 
the main body casing 1 1 of the portable telephone 1 0 is 
successively connected with a transceiver circuit 21 , a 
data processing circuit 22, and a high-speed processing 

35 microprocessor or a digital signal processor (DSP) 23. 
Here, the data processing circuit 22 performs clock con- 
trol on the image and audio signals received by the 
transceiver circuit 21 and serves as an interface to a 
CPU, described later. 

40 [0053] The DSP 23 is connected with an audio codec 
24. The audio codec 24 is connected with a microphone 
25 and a ringer 26. In addition, the audio codec 24 is 
connected with a loudspeaker 29 via a modulation trans- 
mitter circuit 27 and a demodulation receiver circuit 28. 

45 [0054] The data processing circuit 22 and the DSP 23 
are connected to the CPU 30. 

[0055] In addition, the CPU 30 is connected with the 
display panel 12 via a LCD driver 31 , the CCD camera 
1 8 via a signal processing circuit 32, and an open/close 

50 detection sensor 33 which is attached to the open/close 
portion of the open/close cover 1 3 to detect the opened 
or closed status of the open/close cover 13. The CPU 
30 is also connected with a touch panel 34 attached to 
the display panel 12. Via an external l/F 36, connected 

55 to the CPU 30 is a connector 35 which is connected to 
a personal computer or the like and through which var- 
ious data is communicated to and from the personal 
computer or the like. The CPU 30 is also connected with 
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a SRAM 37 in which various personal data are stored 
such as abbreviated telephone numbers to be inputted 
by the user. The CPU 30 is further connected with a 
ROM 38 in which various control programs for the port- 
able telephone are stored. The CPU 30 Is also connect- s 
ed with the spectrum dial 19, and the first operation keys 
K1 and the second operation keys K2, which contain 
various operation keys such as function keys and a ten- 
key pad for use in inputting telephone numbers. 
[0056] The control portion of the portable telephone io 
10 allows the transceiver circuit 21 to receive a radio 
wave through the antenna 20. Then, the data process- 
ing circuit 22 separates the radio waves Into an image 
signal and an audio signal. While being subjected to 
clock control, the image signal Is outputted to the CPU ^5 
30 and the audio signal is outputted to the DSP 23 each 
in accordance with a command from the CPU 30. 
[0057] The audio signal Inputted to the DSP 23 is sub- 
jected to audio processing in the DSP 23 and then in- 
putted to the audio codec 24 for D/A conversion. Then, 20 
the resulting signal is outputted to the loudspeaker 29 
via the modulation transmitter circuit 27 and the demod- 
ulation receiver circuit 28 as well as to the ringer 26. 
[0058] On the other hand, the audio signal inputted 
from the microphone 25 is subjected to A/D conversion ^5 
in the audio codec 24. Then, the resulting signal is trans- 
mitted from the antenna 20 via the DSP 23, the data 
processing circuit 22, and the transceiver circuit 21 . 
[0059] The CPU 30 allows the various control pro- 
grams of the portable telephone stored in the ROM 38 30 
to control the operation of the data processing circuit 22, 
the DSP 23, the LCD driver 31 and the like. 
[0060] That is, in accordance with an operation signal 
from the first operation keys K1 or the second operation 
keys K2, the CPU 30 will read a control program corre- 35 
spending to the operation signal from the ROM 38. 
Then, in accordance with the control program that has 
been read, the CPU 30 will output image data of an op- 
eration window to the LCD driver 31 to allow the display 
panel 12 to display the operation window. In addition, 40 
the CPU 30 controls the operation of the data process- 
ing circuit 22 and the DSP 23, reads data from or writes 
data to the SRAM 37, and communicates data with the 
persona! computer or the like to which the connector 35 
is connected. 45 
[0061 ] Furthermore, when a display window has been 
switched over to a new window through the spectrum 
dial 19, the CPU 30 reads corresponding image data 
_read from the ROM 38 and then outputs the resulting 
data to the LCD driver 31 , thereby allowing the new win- so 
dow to appear on the display panel 12. 
[0062] Furthermore, upon picking-up of an image by 
means of the CCD camera 1 8, the CPU 30 will receive 
the image signal which is sent from the CCD camera 1 8 
and processed in the signal processing circuit 32. Then, 55 
the CPU 30 outputs the Image signal to the LCD driver 
31, thereby allowing the resulting image to appear on 
the display panel 12. 
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[0063] In this example, the portable telephone 10 is 
equipped with six applications: telephone, whafs-new, 
mail, Web, music/image, and PIM (Personal Information 
Manager) applications. As shown in Fig. 4, successively 
displayed on the display panel 12 through the operation 
of the spectrum dial 19 are a telephone window A, a 
what's-new window B, a mail window C, a Web window 
D, a muslc/image window E, and a PIM window F, cor- 
responding to each of the applications. 
[0064] Fig. 5A shows an example of the telephone 
window A to be displayed on the display panel 12, Fig. 
SB shows an example of the whafs-new window B^ Fig. 
5C shows an example of the mail window C, Fig. 5D 
shows an example of the Web window D, Fig. 5E shows 
an example of the music/image window E, and Fig. 5F 
shows an example of the PIM window F. 
[0065] Fig. 6 is a conceptual view illustrating the win- 
dow image of each of the application windows A to F to 
be displayed on the display panel 12. 
[0066] That is, the display windows A to F are con- 
ceptually each assigned to each of the six regions which 
are provided by radially dividing a disc T with its center 
at the spectrum dial 1 9, the display windows A to F being 
arranged as shown in Fig. 4. A rotational operation of 
the spectrum dial 19 allows the disc T to rotate about 
the spectrum dial 19, causing the display windows A to 
F on the disc T to appear successively on the display 
panel 12. 

[0067] Incidentally each of the regions divided radial- 
ly on the disc T is provided with its own color, whereby 
each of the windows A to F is displayed on the display 
panel 12 in a different background color from any one 
of the other regions. 

[0068] In addition, each of the display windows A to F 
is provided spatially with contents Aato Fa correspond- 
ing to each application as conceptually expressed in Fig. 
7. 

[0069] Furthermore, each of the applications Is pro- 
vided with each input edit window A' to F', which is to be 
displayed through a mode change in place of the win- 
dows A to F as shown In Fig. 8. 

[0070] A program stored in the ROM 38 of the control 
part (refer to Fig. 3) organizes the display fonn of the 
windows A to F and the input edit window A' to F' on the 
display panel 12, and the contents Aa to Fa each corre- 
sponding to each of the applications. 
[0071] Fig. 9 is a block diagram showing an embodi- 
ment of the monitoring camera device used in a remote 
monito ring system by means of a portable telephone ac- 
cording to the present invention. 
[0072] This monitoring camera device is to be in- 
stalled at an arbitrary place such as a user's house 
where remote monitoring Is performed. 
[0073] In this Fig. 9, a monitoring camera device 40 
comprises a CCD camera 41 and a controller unit 42 for 
said CCD camera 41 . 

[0074] The controller unit 42 comprises a CPU(con- 
troller)42A which supervises ON/OFF control of the 
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CCD camera 41 and signal processing control of an im- 
age signal to be outputted from said CCD camera 41 , a 
switching circuit 42B which switches on/off a CCD cam- 
era 41 by means of ON/OFF instruction signals b and b' 
(which will be described later) outputted from the CPU 
42A, an interface 42G-which-makes an input signal a to 
be outputted from the CCD camera 41 input into the 
CPU 42A, and a modem 42F which is connected to a 
line connecting terminal T, demodulates a communica- 
tion signal to be inputted from the portable telephone 1 0 
and inputs the modulated communication signal into the 
CPU42Avia an input side interface 42D, and modulates 
an image signal to be outputted from the CPU 42A via 
an output side interface 42E and outputs to the line con- 
necting terminal T (which will be described later). 
[0075] The monitoring camera device 40 is installed 
In a desirable place such as a user's house and the like 
■in a manner where the CCD camera 41 Is oriented to- 
ward the position of an object to be monitored and the 
line connecting terminal T of the controller unit 42 is con- 
nected to a public telephone network N1 . 
[0076] Then, in this monitoring camera device 40, 
when a calling signal is inputted from the portable tele- 
phone 10 into the line connecting terminal T via a mobile 
communication network N2 and the public telephone 
network N1 , the modem 42 F opens the connection line 
to the CPU 42A, demodulates a tone signal indicating a 
password to be inputted subsequently to the calling sig- 
nal, and inputs the demodulated tone signal into the 
CPU 42A via the input side interface 42D. 
[0077] A password which has been set by a user be- 
forehand and comprises a combination of tone signals 
has been memorized in the CPU 42A and based on the 
comparison of this set password with a password indi- 
cated by the tone signal to be inputted from the modem 
42F, when the set password and the password indicated 
by the tone signal coincide, the ON instruction signal b 
is outputted from the CPU 42A to the switching circuit 
42B and when the set password and the password in- 
dicated by the tone signal do not coincide, the line con- 
nection between the CPU 42A and modem 42F is dis- 
connected. 

[0078] When the ON instruction signal b is inputted 
from the CPU 42A, the switching circuit 42B turns on the 

- power supply of the CCD camera 41 and starts imaging 
by means of the CCD camera 41 . 
[0079] Then, while the CPU 42A is line-connected to 
the public telephone network N1 via the modem 42F, 

-this-switching-circult 42B maintains the condition where 
the power isupply of the CCD carriera 41 is ON. 
[0080] Thus, imaging by means of the CCD camera 
41 starts and the image signal a to be obtained through 
the imaging is inputted into the CPU 42A via the inter- 
face 42C. 

[0081 ] This image signal a is processed by compress- 
ing In accordance with a predetermined moving image 
compressing program in the CPU 42A, then outputted 
to the modem 42F via the output side interface 42E, fur- 



ther subjected to signal modulation processing in this 
modem 42F, and then outputted as a digital image signal 
from the line connection terminal T to the public tele- 
phone network N1. 
5 [0082] Herein, when the portable telephone 1 0, which 
- - accesses the monitoring camera device 40 via the pub-- 
lic telephone n etwo rk N 1 and the mobile commun Icatlon 
network N2, disconnects the line connection to this mon- 
itoring camera device 40, the CPU 42A outputs the OFF 
10 Instruction signal b' to the switching circuit 42B and turns 
off the power supply of the CCD camera 41 . 
[0083] Now, an explanation will be given to the oper- 
ating procedures and actions in the portable telephone 
10 when the portable telephone 1.0 accesses the men- 
's itoring camera device 40 and receives a monitored im- 
age from said monitoring camera device 40. 
[0084] Fig. 1 0 is a flowchart showing the main routine 
for the mode change (the selection of an application) of 
the portable telephone 10. 
20 [0085] Referring to Fig. 1 0, the CPU 30 (refer to Fig. 
3) determines if control is in the input edit mode (step 
a1). If control is not in the input edit mode, it is then de- 
termined if the spectrum dial 19 has been operated and 
a link buffer has been set to the application that is to be 
25 selected through the operation of the spectrum dial 19 
(step a2). 

[0088] In the step a2, if the spectrum dial 19 has been 
operated, the mode is switched over to the application 
that has been selected by the operation of the spectrum 

30 dial 1 9. In addition, if the link buffer has been set to the 
selected application, the buffer link is cleared (step a3). 
[0087] Then, control proceeds to the viewer mode 
subroutine of each application (step a4). 
[0088] In the step a2, if the spectrum dial 19 has not 

35 been operated, control proceeds to the subroutine of 
step a4 in the viewer mode of the application that has 
been selected in the previous operation. 
[0089] On the other hand, In step a1 , if control Is in 
the input edit mode^ control proceeds to the subroutine 

40 in the input edit mode of the application that has been 
selected in the previous operation (step a5). 
[0090] Then, it is detennined if the exit key has been 
inputted (step a6). If the exit key has not been inputted, 
control repeats the procedure from the aforementioned 

45 step al. If the exit key has been inputted, control exits 
the viewer mode or the input edit mode of the selected 
application. 

[0091 ] In the mode changing operation of this portable 
telephone 10, when a user accesses the monitoring 

50 camera device 40 installed in the user's house or the 
like, control selects the viewer mode of the telephone 
application so that the telephone window A is displayed 
on the display panel 1 2 of the portable telephone 1 0. 
[0092] Then, when a telephone number set in the 

55 monitoring camera device 40 is inputted by operation of 
the ten-key pad an-anged in the first operation keys K1 
and the second operation keys K2, the CPU 30 trans- 
mits a calling signal based on the inputted telephone 
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number from the antenna 20 via the data processing cir- 
cuit 22 and transceiver circuit 21 (referto Fig. 3). 
[0093] This calling signal is inputted into the line con- 
necting terminal T (refer to Fig. 9) via the mobile com- 
munication network N2 and the public telephone net- 5 
work N1. 

[0094] Then, the calling signal from this portable tel- 
ephone 1 0 is inputted into the modem 42F via the line 
connecting terminal T and when the telephone line be- 
tween the modem and the portable telephone 1 0 is start- 
ed, the user operates the input keys arranged in the first 
operation keys K1 and the second operation keys K2 
and inputs the password that has been set in the mon- 
itoring camera device 40 in advance. 
[0095] Similarly to the calling signal, the tone signal ^5 
indicating this password is inputted into the modem 42F 
and the modem 42F inputs this tone signal into the CPU 
42A via the input side interface 42D. 
[0096] As described above, the CPU 42A compares 
the password indicated by the tone signal to be inputted 20 
with the password that has been set by the user before- 
hand and when the set password and the password in- 
dicated by the tone signal coincide, the CPU 42A out- 
puts the ON instruction signal b to the switching circuit 
42B and makes the switching circuit 42B turn on the 25 
power supply of the CCD camera 41 . 
[0097] When Imaging of the object to be monitored is 
started by the CCD camera 41 whose power supply has 
been turned on and the image signal a thereof is input- 
ted into the CPU 42A via the interface 42C, signal 30 
processing such as compression Is performed in this 
CPU 42A, the image signal is further inputted into the 
modem 42F via the output side interface 42E and signal 
modulating processing is performed, and the signal is 
transmitted from the line connecting terminal T to the 35 
portable telephone 10 via the public telephone network 
N1 and the mobile communication network N2. 
[0098] The portable telephone 1 0, which received the 
digital Image signal, that has been thus transmitted from 
the monitoring camera device 40, by the antenna20 and 40 
the transceiver circuit 21 demodulates this digital image 
signal in the data processing circuit 22 and inputs the 
demodulated digital signal into the CPU 30 while per- 
fomning clock control. 

[0099] Herein, If an audio signal is included in the dig- 
ital image signal, the audio signal Is separated In this 

data processing circuit 22, inputted into the DSP 23, and 
outputted from the speaker 29 of the portable telephone 
_10 as mentioned above. _ 

[0100] The demodulated Image signal, that has been 50 
inputted into the CPU 30, is decompressed in accord- 
ance with the compressing/decompressing program, 
that has been read out from the ROM 38, and then out- 
putted to the LCD driver 31 . 

[0101] Then, based on the image signal to be input- 55 
ted, the LCD driver 31 makes the display panel 12 dis- 
play an image, for example, as shown in Fig. 1 1 obtained 
through imaging of the object to be monitored. 



[0102] Thus, by means of the portable telephone 1 0, 
the user can see the image obtained by imaging a state 
of the user's house in real time. 
[0103] In addition, since it is necessary to input the 
password set by the user to access the monitoring cam- 
era device 40, there is no danger that the others see the 
state of the user's house and the user's privacy is pro- 
tected. 

[0104] An example of the portable Information termi- 
nal according to the present invention is the portable tel- 
ephone 10 that has been described by means of Figs. 
1 to 8 and Fig. 1 0, therefore, the description thereof will 
not be repeated. 

[0105] In the ROM 38 of the portable telephone, the 
SRAM 37 In which abbreviated dials to be Inputted by 
the user and various personal data such as the name 
card information and the like are stored, various control 
programs for the portable telephone, and a congeniality 
judging program (which will be described later) have 
been recorded. 

[0106] Now, an explanation will be given to the oper- 
ating procedures when a view of the surroundings is 
sent by the above portable telephone 1 0 to another port- 
able telephone 10 which is line-connected and actions 
of the portable telephone 1 0 of the same time. 
[0107] In terms of the mode changing operation as 
shown in Fig. 1 0 of this portable telephone 1 0, in a case 
where a user wants to inform the receiver of the place 
where the user is when they are meeting, the user op- 
erates the spectrum dial 19 to change the viewer mode 
to the telephone window A and operates the operation 
keys arranged in the first operation keys K1 and the sec- 
ond operation keys K2 to turn on the CCD camera 1 8. 
[0108] Then, in this condition, the user orients the 
portable telephone 10 toward the surroundings andper- 
fomis imaging by the CCD camera 18. 
[0109] An Image signal outputted from the CCD cam- 
era 1 8 through the imaging thus perfonned is subjected 
to a necessary signal processing by the signal process- 
ing circuit 32 as shown in Fig. 3, then it is inputted into 
the CPU 30, subjected to compressing processing in ac- 
cordance with the signal compressing program that has 
been read out from the ROM 38, and then sent, via the 
data processing circuit 22, the transceivercircuit 21 , and 
the antenna 20, to the receiver's portable telephone 1 0 
that has been line-connected via the mobile communi- 
cation network. 

[0110] Then, in the other portable telephone 1 0 on the 
receiver's side, the image signal received by means of 
the antenna 20 and the transceiver circuit 21 is inputted 
into the CPU 30 via the data processing circuit 22, sub- 
jected to decompressing processing in this CPU 30 in 
accordance with the compressing/decompressing pro- 
gram that has been read out from the ROM 38, and then 
outputted to the LCD driver 31 , By this LCD driver 31 , 
an image showing the surrounding view that has been 
imaged by the CCD camera 1 B of the portable telephone 
1 0 on the sender's side is displayed on the display panel 
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12. 

[01 1 1] Fig. 12 shows an example of the image display 
to be displayed within the telephone window A of the 
display panel 12 of the portable telephone 10 in the 
above condition. 
-- [0112]- Referring tb' FigT 12ran image f displ^ed on" 
the upper right of the telephone window A shows a send- 
er's face and the image data for displaying this Image f 
has been stored in the SRAM 37 beforehand and when 
the line to the sender's portable telephone 10 is con- 
nected, this Image data is read out from the SRAM 37 
by the CPU 30 so as to be displayed. 
[01 1 3] According to the above portable telephone 1 0, 
for example, in a case where friends are meeting in a 
downtown area, in a condition where the portable tele- 
phones 10 which they carry are line-connected to each 
other via the mobile communication network, one of 
' them who arrives first turns on the CCD camera 1 8 and 
images the surrounding view, and sends the image sig- 
nal to the other's portable telephone, whereby the send- 
er can visually infonn the receiver whom the sender Is 
meeting of the location where the sender is. 
[01 14] Accordingly, even If there is no guide Indicating 
where the sender is or if streets are complicated and 
explanation thereof is difficult for the sender, the sender 
can easily Inform the receiver whom the sender is meet- 
ing of the location where the sender is. 
[0115] In particular, when it is difficult to only vocally 
explain the place and the like or when the sender is poor 
at explanation, it becomes very effective to provide the 
receiver with the above described image. 
[0116] Furthermore, in addition to the method for us- 
ing a portable telephone as described above, the above 
portable telephone 10 can be used in other methods. 
For example, when a person is involved in an accident, 
It can be used to image, by the CCD camera 18, the 
scene of the accident for sending and when a person 
meets with disaster, it can be used to image the sur- 
rounding view for sending so that the receiver confinns 
the scene of the disaster. 

[0117] Moreover, the above portable telephone 10 
can be used in still another method wherein when the 
sender wants to talk with the receiver at a distant place 
about a commodity that the sender wants to buy, the 
sender can Image the commodity by the CCD camera 
1 8 and send the Image signal thereof. 



Claims 

1 . A portable telephone comprising: 
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a display part which can display a moving im- 
age; 4. 
an image signal receiving part which receives 55 
an Image signal sent over a mobile communi- 
cation network; 

an image signal reproducing part which repro- 



duces said image signal which has been re- 
ceived by said image signal receiving part, and 
makes said display part display a reproduced 

image; and 

. .a_petniJssion signal _seri.ding,part_for,sending.a^ 
pemnlssion signal to permit an image-pickup 
part to output image signal to said Image-pick- 
up part to be connected via the mobile commu- 
nication network. 

:. A portable telephone as set forth in Claim 1 further 
comprises a decompressing part for decompress- 
ing a compressed digital Image signal which has 
been received by said image signal receiving part. 

. A remote monitoring system by means of a portable 
telephone, comprising: 

a portable telephone; and 
a monitoring camera device which is connected 
to said portable telephone via a mobile commu- 
nlcatlon network and sends an image signal ob- 
tained by imaging, wherein 

said portable telephone comprises: 

a display part which can display a moving im- 
age; 

an Image signal receiving part which receives 
an Image signal sent over the mobile commu- 
' nication network; 

an image signal reproducing part which repro- 
duces said image signal which has been re- 
ceived by said image signal receiving part and 
makes the display part display a reproduced 
image; and 

a permission signal sending part for sending a 
permission signal to permit a monitoring cam- 
era device to output an Image signal to said 
monitoring camera device to be connected via 
the mobile communication network, and where- 
in 

said monitoring camera device comprises: 
an image pickup part which is Installed and 
oriented toward a desirable object to be monitored 
and an image signal sending permission part which 
detects the permission signal to be sent from the 
pennission signal sending part of the portable tele- 
phone via the mobile communication network and 
permits sending of an image signal from said im- 
age-pickup part to said portable telephone. 

A remote monitoring system by means of a portable 
telephone as set forth in Claim 3, wherein said mon- 
itoring camera device further comprises a com- 
pressing part for compressing an image signal to be 
sent from said image pickup part to said portable 
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5. A remote monitoring system by means of a portable 
telephone as set forth In Claim 3, wherein said port- 
able telephone further comprises a decompressing s 
partfor decompressing a compressed Image signal 
which has been received by said image signal re- 
ceiving part. 

6. A portable Infonnation terminal comprises: 



a sending/receiving part which sends/receives 
an image signal via a mobile communication 
network; 

an Image display part which displays an image 
by said image signal received by said sending/ 
receiving part; and 

an image-pickup part which perfonns imaging 
and sends an image signal obtained through 
Imaging by means of said sending/receiving 20 
part. 



7. A portable information tenninal as set forth in Claim 
6, wherein said image-pickup part is a CCD camera. 

8. A method for using a portable information terminal 
which comprises a sending/receiving part which 
perfonns sending/receiving of an image signal via 
a mobile communication network, an image display 
part which displays an image In a form of an image 30 
signal received by said sending/receiving part, and 

an image-pickup part which performs imaging and 
sends image signals obtained through imaging by 
means of said sending/receiving part, said method 
comprising the steps of: 



imaging a view of a surrounding area by means 
of said image-pickup device; 
sending the image signal obtained through said 
imaging step to another portable Information 40 
tenninal that is line-connected via a mobile 
communication network by means of said 
sending/receiving part; and 
making the image of the view of the surrounding 
area thus imaged to be displayed In an image 45 
display part of another portable infonnation ter- 
minal. 

.9. .A method for using a portable, information terminal 
as set forth in Claim 8, wherein 

said view of a surrounding area to be imaged 
by said image-pickup device is a view of asurround- 
ing area of a place of meeting. 
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(57) Real-time images and audio are monitored 
from a remote place anytime at an arbitrary place with 
a portabletelephone. The portabletelephone comprises 
a display panel which can display a moving image, an 
Image signal receiving part which receives an image sig- 
nal sent over the mobile communication network N2, an 
image signal reproducing part which reproduces the im- 
age signal which has been received by this image signal 
receiving part and makes the display part display the 
reproduced image , and a permission signal sending part 
for sending a permission signal to permit an image-pick- 
up part to output an image signal to the image-pickup 
part to be connected via the mobile communication net- 
work. According to another aspect, a portable informa- 
tion terminal is constructed so that the sender can easily 



send information of the place or surrounding view where 
he/she is, and comprises a sending/receiving part which 
sends/receives an image signal via the mobile commu- 
nication network, a display panel which displays an im- 
age according to the received image signal, and a CCD 
camera which performs imaging and sends an Image 
signal by the sending/receiving part. The view of the sur- 
rounding area is imaged by the CCD camera, the ob- 
tained image signal is sent to another portable tele- 
phone that is line-connected via the mobile communi- 
cation network, and thus the picked-up image of the sur- 
rounding area is displayed on the display panel of the 
-Other portable telephone. . 
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